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. Abstract. Entropic Dynamics (ED) [1] is a theoretical framework developed to investigate the 

possibility that laws of physics reflect laws of inference rather than laws of nature. In this work, a 
RED (Reversible Entropic Dynamics) model is considered. The geometric structure underlying the 
curved statistical manifold is studied. The trajectories of this particular model are hyperbolic 
curves (geodesies) on Finally, some analysis concerning the stabiUty of these geodesies on 
c/3 ' is carried out. 

c/3 ; 
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o : 1. INTRODUCTION 
• 1— I 

^ 1 We use Maximum relative Entropy (ME) methods [2, 3] to construct a RED model. ME 

p ■ methods are inductive inference tools. They are used for updating from a prior to a pos- 
terior distribution when new information in the form of constraints becomes available. 

^ I We use known techniques [1] to show that they lead to equations that are analogous 

■ to equations of motion. Information is processed using ME methods in the framework 
of Information Geometry (IG) [4]. The ED model follows from an assumption about 

Q I what information is relevant to predict the evolution of the system. We focus only on 

' reversible aspects of the ED model. In this case, given a known initial state and that 

^ . the system evolves to a final known state, we investigate the possible trajectories of the 

O '. system. Reversible and irreversible aspects in addition to further developments on the 

■ ED model are presented in a forthcoming paper [5] . Given two probability distributions, 
. ^ ■ how can one define a notion of "distance" between them? The answer to this question is 

^! provided by IG. Information Geometry is Riemannian geometry applied to probability 

r-| I theory. As it is shown in [6, 7], the notion of distance between dissimilar probability 

Ph' distributions is quantified by the Fisher-Rao information metric tensor. 
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2. THE RED MODEL 



We consider a RED model whose microstates span a 2D space labelled by the variables 
xi e R"^ andx2 e R. We assume the only testable information pertaining to the quantities 
x\ and X2 consists of the expectation values {x\), {xi) and the variance Ajc2. These three 
expected values define the 3D space of macrostates of the system. Our model may be 
extended to more elaborate systems where higher dimensions are considered. However, 
for the sake of clarity, we restrict our consideration to this relatively simple case. A 
measure of distinguishability among the states of the ED model is achieved by assigning 

a probability distribution p'^^"^^ {x\d^ to each macrostate . The process of assigning a 

probability distribution to each state provides with a metric structure. Specifically, 
the Fisher-Rao information metric defined in (6) is a measure of distinguishability 
among macrostates. It assigns an IG to the space of states. 



2.1. The Statistical Manifold 

Consider a hypothetical physical system evolving over a two-dimensional space. 
The variables x\ and X2 label the ID space of microstates of the system. We assume 
that all information relevant to the dynamical evolution of the system is contained in 
the probability distributions. For this reason, no other information is required. Each 
macrostate may be thought as a point of a three-dimensional statistical manifold with 

>(l)_/..\ fl(2) 



coordinates given by the numerical values of the expectations 6\ — {x\) , Q\ ' = {x2 

^2 = ^2- The available information can be written in the form of the foUowin 
constraint equations, 

(^l) = ^Q^'dxiXipi (xi\e''p^ , {X2) = J^^dX2X2P2 (x2\ef\e^2^^ , 
AX2 = ^{{x2-{x2)f) = [j^:dX2 {X2 - {X2)fp2 (x2\df\d^}^)] ' , 



(1) 



where O^^^ = (x\), 0^^^ = {x2) and 9^2^ = Ax2. The probability distributions pi and p2 
are constrained by the conditions of normalization, 

j^'^dxm = h iydx2P2 (^2|0f\0f ) = 1. (2) 

Information theory identifies the exponential distribution as the maximum entropy dis- 
tribution if only the expectation value is known. The Gaussian distribution is identified 
as the maximum entropy distribution if only the expectation value and the variance are 

known. ME methods allow us to associate a probability distribution p^""^ to each 

point in the space of states = (^0^^\ 0^^\ ^2^"*)- The distribution that best reflects 
the information contained in the prior distribution m (x) updated by the information 



((jci) , (jC2) i^i) is obtained by maximizing the relative entropy 



where m(x) = m is the uniform prior probability distribution. The prior m (x) is set to 
be uniform since we assume the lack of prior available information about the system 
(postulate of equal a priori probabilities). Upon maximizing (3), given the constraints 
(1) and (2), we obtain 

p(-) {x\e) =p, {x,\e\'^)p2 (.2|0f^^f ) = -e-^^^e''"^, (4) 

where d[^^ = jj.^, 0^^^ = and 6^2^ — 02. The probability distribution (4) encodes 
the available information concerning the system. Note that we have assumed uncoupled 
constraints between the microvariables xi and X2. In other words, we assumed that in- 
formation about correlations between the microvariables need not to be tracked. This 
assumption leads to the simplified product rule (4). Coupled constraints however, would 
lead to a generalized product rule in (4) and to a metric tensor (7) with non-trivial off- 
diagonal elements (covariance terms). Correlation terms may be fictitious. They may 
arise for instance from coordinate transformations. On the other hand, correlations may 
arise from external fields in which the system is immersed. In such situations, correla- 
tions between xi and X2 effectively describe interaction between the microvariables and 
the external fields. Such generalizations would require more delicate analysis. 



3. THE METRIC STRUCTURE OF 

We cannot determine the evolution of microstates of the system since the available 
information is insufficient. Not only is the information available insufficient but we 
also do not know the equation of motion. In fact there is no standard "equation of 
motion". Instead we can ask: how close are the two total distributions with parameters 
{111^112,02) and (jUj -\- d^i,^2'^ d^2-:^'2--\- d02)^ Once the states of the system have 
been defined, the next step concerns the problem of quantifying the notion of change 
from the state Q to the state Q + dQ. A convenient measure of change is distance. The 
measure we seek is given by the dimensionless "distance" ds between p^^°*^ {x.\B^ and 
p{tot) (^\Qj^dd^ [4] : 

ds'^ = gijdO'dej, (5) 

where 

«, = /^/«)(,J|g) (6) 



is the Fisher-Rao metric [6, 7]. Substituting (4) into (6), the metric gij on becomes. 
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(7) 



From (7), the "length" element (5) reads 



1 J 2 1^2 2 



(8) 



We bring attention to the fact that the metric structure of is an emergent (not funda- 
mental) structure. It arises only after assigning a probability distribution (x\6^ to 

each state 6. 



3.1. The Statistical Curvature of 

We study the curvature of This is achieved via application of differential geome- 
try methods to the space of probability distributions. As we are interested specifically in 
the curvature properties of recall the definition of the Ricci scalar R, 

R = g''Rij, (9) 

where g'^^gkj — S'j so that g^j — (^gij) ^ — diag{ill,02,^). The Ricci tensor Rij is given 

by, 

Rij = dkl^ij - djl^f^ + ^ifkn - ^k^jm- (10) 

The Christoffel symbols appearing in the Ricci tensor are defined in the standard 
way, 

rfy = ^Z"' {digmj + djgim - dmgij) • (11) 

Using (7) and the definitions given above, the non- vanishing Christoffel symbols are 
^11 = -^17' r22 = 2^' = and r^3 = = The Ricci scalar becomes 

R = -\<Q. (12) 

From (12) we conclude that is a 3D curved manifold of constant negative {R = — I) 
curvature. 



4. CANONICAL FORMALISM FOR THE RED MODEL 



We remark that RED can be derived from a standard principle of least action 
(Maupertuis- Euler-Lagrange-Jacobi-type) [1,8]. The main differences are that the 
dynamics being considered here, namely Entropic Dynamics, is defined on a space of 
probability distributions Ms-, not on an ordinary vectorial space V and the standard 
coordinates qj of the system are replaced by statistical macrovariables 

Given the initial macrostate and that the system evolves to a final macrostate, we 
investigate the expected trajectory of the system on It is known [8] that the classical 
dynamics of a particle can be derived from the principle of least action in the form, 

5Jjacobi[q]=sl^''ds^(qj,^,s,H^ =0, (13) 

where qj are the coordinates of the system, s is an arbitrary (unphysical) parameter 
along the trajectory. The functional ^ does not encode any information about the time 
dependence and it is defined by, 

where the energy of the particle is given by 

H = E = T + U{q) = Wajk (q) qjqk + U{q). (15) 

The coefficients ajk{q) are the reduced mass matrix coefficients and q = We now 
seek the expected trajectory of the system assuming it evolves from the given ini- 
tial state ^ = (Ml {si),l-i2{si),<y2{si)) to a new state d^w = 6^ + dd^ = 
(/i 1 [s f) , /i2 {sf) , (72 (■^/) ) • It can be shown that the system moves along a geodesic in 
the space of states [1]. Since the trajectory of the system is a geodesic, the RED-action 
is itself the length: 

where — ^ and (0, 0) is the Lagrangian of the system, 

^{e,e) = {gijd'd^)i (iv) 

The evolution of the system can be deduced from a variational principle of the Jacobi 
type. A convenient choice for the affine parameter s is one satisfying the condition 

gij^^ = 1. Therefore we formally identify s with the temporal evolution parameter 
T. Performing a standard calculus of variations, we obtain, 

djRED [0] ^JdT (\^e'e^ - ^) 50^ = oyseK (i8) 



Note that from (18), ^ = ^-^d'd-'. This "equation of motion" is interesting because 

it shows that if = for a particular k then the corresponding O^is conserved. This 

suggests to interpret 6k as momenta. Equations (18) and (11) lead to the geodesic 
equations, 

-^T^^^'J^ d^-^- ^^^^ 

Observe that (19) are second order equations. These equations describe a dynamics 
that is reversible and they give the trajectory between an initial and final position. The 
trajectory can be equally well traversed in both directions. 



4.1. Geodesies on 

We seek the explicit form of (19) for the statistical coordinates (/ij,/i2,0'2) 
parametrizing the submanifold of ms = ^p'^'"'^ (x\e^ e^s-O satisfies (19)}. 

Substituting the explicit expression of the connection coefficients found in subsection 
(2.3) into (19), the geodesic equations become, 

IW Hi\dzJ ~ ~dz^ (72 dz dx ~ 

(20) 

2 . / \ 2 



dx^ a2\dx ) 2a2\dT ) - 



This is a set of coupled ordinary differential equations, whose solutions have been 
obtained by use of mathematics software (Maple) and analytical manipulation: 

ju^ (t) =A\ (cosh(aiT) -sinh(aiT)), 

M2 (t) - ^ ^ ^ +^2, 

cosh (2a2T) - sinh {la2x) + ^ (21) 
cosh ( a2 1") — sinh ( i") 



C72(t) =A2 



A 

cosh (2a2T) - sinh {2a2T) + ^ 

2 



The quantities Ai, A2, B2, (X.\ and are the five integration constants (5 = 6—1, 

(^0 jO^^^ = 1). The coupling between the parameters and 02 is reflected by the 

fact that their respective evolution equations in (21) are defined in terms of the same 
integration constants A2 and Ct2- Equations (21) parametrize the evolution surface of the 
statistical submanifold C By eliminating the parameter T, 02 can be expressed 



FIGURE 1. The Statistical Submanifold Evolution Surface 



explicitly as a function of /ij and 



<72(M1'M2) 




Ml"' (M2-^2)- 



(22) 



This equation describes the submanifold evolution surface. To give a qualitative sense of 
this surface, we plot (22) in Figure 1 for a special choice of a Id set of initial conditions 
(a2 = 2ai while Ai, A2 and B2 are arbitrary). Equations (20) are used to evolve this 
id line to generate the 2d surface of m,. This figure is indicative of the instability of 
geodesies under small perturbations of initial conditions. 



We briefly investigate the stability of the trajectories of the RED model considered on 
It is known [8] that the Riemannian curvature of a manifold is closely connected 
with the behavior of the geodesies on it. If the Riemannian curvature of a manifold is 
negative, geodesies (initially parallel) rapidly diverge from one another. For the sake of 
simplicity, we assume very special initial conditions: oc = OCi = a2 t, ^ ^ 1 ; Ai and 

^ o(X2 

B2 are arbitrary. However, the conclusion we reach can be generalized to more arbitrary 
initial conditions. Recall that is the space of probability distributions p^'"'^ (^\^^ 
labeled by parameters /ij, /i2,cr2. These parameters are the coordinates for the point 
jr,(fof)^ and in these coordinates a volume element dV^^ reads. 



5. ABOUT THE STABILITY OF GEODESICS ON 




(23) 



where ^ = | det (g/y ) | = -j^^ . Hence, using (23), the volume of an extended region AV^^ 
of is, 

AK#,(T;a)=K#,(T)-K#,(0)= III V8d^id^2d02. (24) 

Mi(0)M2(0)<J2(0) 

Finally, using (21) in (24), the temporal evolution of the volume AV^^ becomes, 

AV^^{T;a) = ^e"\ (25) 

Equation (25) shows that volumes AV^^{T;a) increase exponentially with T. Con- 
sider the one-parameter (a) family of statistical volume elements -^y^^^ (ct) = 

{AV^^ (t; a)}^. Note that a = ai = - (-^^) > 0. The stability of the geodesies 

V "l / T=0 

of the RED model may be studied from the behavior of the ratio ry^ of neighboring 
volumes AV^^ (t; a + da) and AV^^ (t; a), 

def AK#^(t; g + gg) 
^^-^ = Ay^,(x;g) • ^^'^ 

Positive 5g is considered. The quantity ry^^ describes the relative volume changes in 
T for volume elements with parameters a and g + 5a. Substituting (25) in (26), we 
obtain 

rv.^., = e'"'. (27) 

Equation (27) shows that the relative volume change ratio diverges exponentially un- 
der small perturbations of the initial conditions. Another useful quantity that encodes 
relevant information about the stability of neighbouring volume elements might be the 
entropy-like quantity S defined as, 

S = logV^^ (28) 
where is the average statistical volume element defined as, 

V^^ = (AV^^)^ 1 J AV^^ (t'; a) dz'. (29) 



Indeed, substituting (25) in (29), the asymptotic limit of (28) becomes, 

S ^ ax. (30) 

Doesn't equation (30) resemble the Zurek-Paz chaos criterion [9, 10] of linear entropy 

increase under stochastic perturbations? This question and a detailed investigation of 
the instability of neighbouring geodesies on different curved statistical manifolds are 



addressed in [12] by studying the temporal behaviour of the Jacobi field intensity [1 1] on 
such manifolds. 

Our considerations suggest that suitable RED models may be constructed to describe 
chaotic dynamical systems and, furthermore, that a more careful analysis may lead to 
the clarification of the role of curvature in inferent methods for physics [12, 13]. 

6. FINAL REMARKS 

A RED model is considered. The space of microstates is ID while all information nec- 
essary to study the dynamical evolution of such a system is contained in a 3Z) space of 

macrostates h was shown that possess the geometry of a curved manifold of 
constant negative curvature {R — — I). The geodesies of the RED model are hyperbolic 
curves on the submanifold of Furthermore, considerations of statistical volume 
elements suggest that these entropic dynamical models might be useful to mimic ex- 
ponentially unstable systems. Provided the correct variables describing the true degrees 
of freedom of a system be identified, ED may lead to insights into the foundations of 
models of physics. 
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